Method of computing a hologram for reconstructing an object using a display device

ABSTRACT

A method of computing a hologram for reconstructing an object using a display device. The display device enables a holographic reconstruction of the object. The display device includes a light source and an optical system to illuminate a hologram-bearing medium being encodable with the hologram. The method includes the steps of: (a) computing the hologram by determining the wavefronts at an approximate observer eye position that would be generated by a real version of the object to be reconstructed; and (b) encoding the computed hologram in the hologram-bearing medium.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.13/216,761, filed Aug. 24, 2011, which is a continuation of U.S.application Ser. No. 11/937,991, filed Nov. 9, 2007, now U.S. Pat. No.8,027,071, which is a continuation of U.S. application Ser. No.11/427,640, filed Jun. 29, 2006, now U.S. Pat. No. 7,315,408, which is acontinuation application of U.S. application Ser. No. 10/534,877, nowU.S. Pat. No. 7,839,548, filed by A. Schwerdtner on May 12, 2005,entitled “Video Hologram and Device for Reconstructing Video Holograms,”the contents of which are hereby incorporated by reference.

U.S. application Ser. No. 10/534,877 is, in turn, related to, and claimspriority from, PCT Application No. PCT/DE03/03791, filed on Nov. 11,2003 and to German Patent application DE 10253292.3, filed on Nov. 13,2002, the contents of both of which are hereby incorporated byreference.

FIELD OF THE INVENTION

The present invention relates to a video hologram and a device forreconstructing video holograms having an optical system that includes atleast one light source, a lens and a hologram-bearing medium composed ofcells arranged in a matrix or an otherwise regular pattern, with atleast one opening per cell, and with the phase or amplitude of theopening being controllable.

BACKGROUND OF THE INVENTION

Devices for reconstructing video holograms using acousto-opticalmodulators (AOM) are known from prior art, as detailed in, for instance,U.S. Pat. No. 5,172,251 issued to Benton et al. on Dec. 15, 1992entitled “Three dimensional display system,” the contents of which arehereby incorporated by reference. Such acousto-optical modulatorstransform electric signals into optical wave fronts, which arerecomposed in a video frame using deflection mirrors to formtwo-dimensional holographic areas. A scene visible for the viewer isreconstructed from the individual wave fronts using further opticalelements. The optical means used, such as lenses and deflectionelements, have the dimensions of the reconstructed scenes. Due to theirgreat depth, these elements are voluminous and heavy. It is difficult tominiaturize them, so that their range of applications is limited.

Another way to generate large video holograms is the so-called “tilingmethod”, using computer-generated holograms (CGH). This method isdescribed in for instance PCT patent publication WO 00/75698 of PCTPatent Application PCT/GB2000/001901 filed on May 18, 2000 by Pain et.al entitled “Holographic Displays” and in U.S. Pat. No. 6,437,919 B1issued to Brown, et al. on Aug. 20, 2002 “System for the production of adynamic image for display”, both of which are hereby incorporated byreference. In the tiling method, small CGHs having a small pitch arecreated using an optical system. In the first step of the method, therequired information is written to fast matrices that have a smallpitch, such as electronically addressable spatial light modulators(EASLM). These fast matrices are then reproduced on to a portion of asuitable holographic medium. A large video hologram is composed of thetiled replicas of the fast matrices. Usually, an optically addressablespatial light modulator (OASLM) is used as holographic medium. In asecond step, the composed video hologram is reconstructed with coherentlight in transmission or reflection.

In the CGH with controllable openings arranged in a matrix or in anotherwise regular pattern as described in, for instance, PCTpublications number WO 01/95016 A1 of PCT patent applicationPCT/GB2001/002302 filed on May 24, 2001 by Payne et al. entitled“Computation Time Reduction for Three-Dimensional Displays” or in Fukayaet al., “Eye-position tracking type electro-holographic display usingliquid crystal devices”, Proceedings of EOS Topical Meeting onDiffractive Optics, 1997, the diffraction on small openings is takenadvantage of for encoding the scenes. The wave fronts emerging from theopenings converge in object points of the three-dimensional scene beforethey reach the viewer. The smaller the pitch, and thus the smaller theopenings in the CGHs, the greater is the diffraction angle, i.e. theviewing angle. Consequently, with these known methods enlarging theviewing angle means to improve the resolution.

As is generally known, in Fourier holograms the scene is reconstructedas a direct or inverse Fourier transform of the hologram in a plane.This reconstruction is continued periodically at a periodicity interval,the extension of the periodicity interval being inversely proportionalto the pitch in the hologram.

If the dimension of the reconstruction of the Fourier hologram exceedsthe periodicity interval, adjacent diffraction orders will overlap. Asthe resolution is gradually decreased, i.e. as the pitch of the openingsincreases, the edges of the reconstruction will be increasinglydistorted by overlapping higher diffraction orders. The usable extent ofthe reconstruction is thus gradually limited.

If greater periodicity intervals and thus greater viewing angles are tobe achieved, the required pitch in the hologram comes closer to thewavelength of the light. Then, the CGHs must be sufficiently large inorder to be able to reconstruct large scenes. These two conditionsrequire a large CGH having a great number of openings. However, this iscurrently not feasible in the form of displays with controllableopenings, as discussed in, for instance, U.S. Pat. No. 6,831,678 issuedto Travis on Dec. 14, 2004 entitled “Autostereoscopic display”, thecontents of which are hereby incorporated by reference. CGH withcontrollable openings only measure one to several inches, with thepitches still being substantially greater than 1 μm.

The two parameters, pitch and hologram size, are characterized by theso- called space-bandwidth product (SBP) as the number of openings inthe hologram. If the reconstruction of a CGH with controllable openingsthat has a width of 50 cm is to be generated so that a viewer can seethe scene at a distance of 1 m and in a 50-cm-wide horizontal viewingwindow, the SBP in horizontal direction is about 0.5·10⁶. Thiscorresponds to 500,000 openings at a distance of 1 μm in the CGH.Assuming an aspect ratio of 4:3, 375,000 openings are required in thevertical direction. Consequently, the CGH comprises 3.75·10¹¹ openings,if three color sub-pixels are taken into consideration. This number willbe tripled if the fact is taken into account that the CGH withcontrollable openings usually only allows the amplitudes to be affected.The phases are encoded taking advantage of the so-called detour phaseeffect, which requires at least three equidistant openings per samplingpoint. SLM having such a great number of controllable openings arehitherto unknown.

The hologram values must be calculated from the scenes to bereconstructed. Assuming a color depth of 1 Byte for each of the threeprimary colors and a frame rate of 50 Hz, a CGH requires an informationflow rate of 50·10¹²=0.5·10¹⁴ Byte/s. Fourier transformations of dataflows of this magnitude exceed the capabilities of today's computers byfar and thus do not allow holograms to be calculated based on localcomputers. However, transmitting such an amount of data through datanetworks is presently unfeasible for normal users.

In order to reduce the enormous number of computations it has beenproposed not to calculate the entire hologram, but only such parts of itthat can be seen directly by the viewer, or such parts that change. Thekind of hologram which consists of addressable sub-regions, such as theabove-mentioned “tiling hologram”, is disclosed in the above-mentionedpatent specification WO 01/95016 A1. Starting point of the calculationsis a so-called effective exit pupil, the position of which can coincidewith the eye pupil of the viewer. The image is tracked as the viewerposition changes by continuous recalculation of the hologram part thatgenerates the image for the new viewer position. However, this partlynullifies the reduction in the number of computations.

The disadvantages of the known methods can be summarized as follows:Arrangements with acousto-optical modulators are too voluminous andcannot be reduced to dimensions known from state-of-the-art flatdisplays; video holograms generated using the tiling method aretwo-stage processes which require enormous technical efforts and whichcannot easily be reduced to desktop dimensions; and arrangements basedon SLM with controllable openings are too small to be able toreconstruct large scenes. There are currently no large controllable SLMwith extremely small pitches, which would be needed for this, and thistechnology is further limited by the computer performance and datanetwork bandwidth available today.

SUMMARY OF THE INVENTION

The invention is defined in the appended claims. In one implementation,video holograms and devices for reconstructing video holograms withcontrollable openings according to the present invention arecharacterized in that in the viewing plane at least one viewing windowis formed in a periodicity interval as a direct or inverse Fouriertransform of the video hologram, said viewing window allowing a viewerto view a reconstruction of a three-dimensional scene. The maximalextent of the viewing window corresponds to the periodicity interval inthe plane of the inverse Fourier transformation in the image plane ofthe light source. A frustum stretches between the hologram and theviewing window. This frustum contains the entire three-dimensional sceneas a Fresnel transform of the video hologram.

The viewing window is limited approximately to and positioned inrelation to one eye, an eye distance of a viewer or to another suitablearea.

In an implementation, another viewing window is provided for the othereye of the viewer. This is achieved by the fact that the observed lightsource is displaced or added a second, real or virtual, adequatelycoherent light source at another suitable position to form a pair oflight sources in the optical system. This arrangement allows thethree-dimensional scene to be seen with both eyes through two associatedviewing windows. The content of the video hologram can be changed, i.e.re-encoded, according to the eye position in synchronism with theactivation of the second viewing window. If several viewers view thescene, more viewing windows can be generated by turning on additionallight sources.

In another implementation of the device for reconstructing a videohologram, the optical system and the hologram-bearing medium arearranged so that the higher diffraction orders of the video hologramhave a zero point for the first viewing window or an intensity minimumat the position of the second viewing window. This prevents the viewingwindow for one eye to cross-talk the other eye of the viewer or to otherviewers. It is thus taken advantage of the decrease in intensity of thelight towards higher diffraction orders, which is due to the finitewidth of the openings of the hologram-bearing medium and/or the minimaof the intensity distribution. The intensity distribution forrectangular openings, for example, is a sinc² function which rapidlydecreases in amplitude and forms a sin² function which decreases as thedistance grows.

The number of openings in the display determines the maximum number ofvalues that must be calculated for the video hologram. The transmissionof data from a computer or through a network to the display representingthe video hologram is limited to the same number of values. The dataflow rate does not substantially differ from the data flow rates knownfrom typical displays used today. Now, this will be illustrated with thehelp of an example.

If the viewing window is reduced, for example, from 50 cm (horizontal)by 37.5 cm (vertical) to 1 cm by 1 cm by choosing a sufficientlylow-resolution display, the number of openings in the hologram will dropto 1/1875. The required bandwidth is reduced in the same way during datatransmission through a network. Video holograms created with knownmethods require 10¹² openings, while this number is reduced to 5·10⁸pixels in this example. The scene can be viewed in full through theremaining viewing window. These requirements on pitch and hologram sizeaccording to the space-bandwidth product can already be fulfilled bydisplays available today. This allows the inexpensive realization oflarge real-time video holograms on displays with large pitches andhaving a large viewing window.

The viewing window is tracked by mechanically or electronicallydisplacing the light sources, by using movable mirrors or by using lightsources which can be adequately positioned in any other way. The viewingwindows are displaced according to the displacement of the light sourceimages. If the viewer moves, the light source(s) is (are) spatiallydisplaced so that the viewing windows follow the eyes of the viewer(s).This is to ensure that the viewers can also see the reconstructedthree-dimensional scene when they move, so that their freedom ofmovement is not limited. Several systems are known for detecting theposition of the viewers, e.g. systems based on magnetic sensors can beused beneficially for this.

An implementation of this invention also allows the efficientreconstruction of a video hologram in color. Here, the reconstruction isperformed with at least three openings per cell, representing the threeprimary colors. The amplitude or phase of the openings may becontrollable, and the openings may be encoded individually for each ofthe primary colors. Another possibility of reconstructing a videohologram in color is to perform at least three reconstructions one afteranother, namely for the individual primary colors, using the device ofthe present invention.

An implementation of this invention allows the efficient generation ofholographic reconstructions of spatially extended scenes throughcontrollable displays, such as TFT flat screens, in real-time andproviding large viewing angles. These video holograms can be usedbeneficially in TV, multimedia, game and design applications, in themedical and military sectors, and in many other areas of economy andsociety. The three-dimensional scenes can be generated by a computer orin any other way.

These and other features of the invention will be more fully understoodby references to the following drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

An embodiment of the present invention is illustrated and explainedbelow in conjunction with the accompanying drawings, wherein

FIG. 1 is a general illustration of a video hologram and a device forreconstructing video holograms showing the generation of the diffractionorders and the position of a viewing window;

FIG. 2 is a general illustration of a device for reconstructing videoholograms showing a three-dimensional scene which can be viewed througha viewing window;

FIG. 3 is a general illustration of a device for reconstructing videoholograms showing the encoding of the three-dimensional scene in a partof the video hologram;

FIG. 4 is a diagram showing the light intensity distribution in theviewing plane depending on the diffraction orders; and

FIG. 5 is a general illustration of a device for reconstructing videoholograms showing the position of the viewing windows for both eyes of aviewer with regard to the diffraction orders to prevent cross-talking.

DETAILED DESCRIPTION

A device for reconstructing video holograms comprises thehologram-bearing medium, a sufficiently coherent, real or virtual, pointor line light source and an optical system. The video hologram-bearingmedium itself consists of cells which are arranged in a matrix or in anotherwise regular pattern with at least one opening per cell, the phaseor amplitude of said opening being controllable. The optical system forreconstructing the video hologram can be realized by an optical imagingsystem known in the art, consisting of a point or line laser or asufficiently coherent light source.

FIG. 1 shows the general arrangement of a video hologram and itsreconstruction. A light source 1, a lens 2, a hologram-bearing medium 3and a viewing plane 4 are arranged one after another, seen in thedirection of the propagating light. The viewing plane 4 corresponds withthe Fourier plane of the inverse transform of the video hologram withthe diffraction orders.

The light source 1 is imaged on to the viewing plane 4 through anoptical system, represented by the lens 2. If a hologram-bearing medium3 is inserted, it is reconstructed in the viewing plane 4 as an inverseFourier transform. The hologram-bearing medium 3 with periodic openingscreates equidistantly staggered diffraction orders in the viewing plane4, where the holographic encoding into higher diffraction orders takesplace, e.g. by way of the so-called detour phase effect. Because thelight intensity decreases towards higher diffraction orders, the 1^(st)or −1^(st) diffraction order is used as the viewing window 5. If notexplicitly expressed otherwise, the 1^(st) diffraction order will betaken as a basis in the further description of the invention.

The dimension of the reconstruction was chosen here to correspond withthe dimension of the periodicity interval of the 1^(st) diffractionorder in the viewing plane 4. Consequently, higher diffraction ordersare attached without forming a gap, but also without overlapping.

Being the Fourier transform, the selected 1^(st) diffraction order formsthe reconstruction of the hologram-bearing medium 3. However, it doesnot represent the actual three-dimensional scene 6. It is only used asthe viewing window 5 through which the three-dimensional scene 6 can beobserved (see FIG. 2). The actual three-dimensional scene 6 is indicatedin the form of a circle inside the bundle of rays of the 1^(st)diffraction order. The scene is thus located inside the reconstructionfrustum which stretches between the hologram-bearing medium 3 and theviewing window 5. The scene 6 is rendered as the Fresnel transform ofthe hologram-bearing medium 3, whereas the viewing window 5 is a part ofthe Fourier transform.

FIG. 3 shows the corresponding holographic encoding. Thethree-dimensional scene is composed of discrete points. A pyramid withthe viewing window 5 being the base and the selected point 7 in thescene 6 being the peak, is prolonged through this point and projected onto the hologram-bearing medium 3. A projection area 8 is created in thehologram-bearing medium 3 that point being holographically encoded inthe projection area. The distances between the point 7 to the cells ofthe hologram-bearing medium 3 can be determined in order to calculatethe phase values. This reconstruction allows the size of the viewingwindow 5 to be constrained by the periodicity interval. If, however, thepoint 7 was encoded in the entire hologram-bearing medium 3, thereconstruction would extend beyond the periodicity interval. The viewingzones from adjacent diffraction orders would overlap, which would resultin the viewer seeing a periodic continuation of the point 7. Thecontours of a surface encoded in this manner would appear blurred due tomultiple overlapping.

The intensity decrease towards higher diffraction orders is takenadvantage of to suppress cross-talking to other viewing windows. FIG. 4shows schematically a light intensity distribution over the diffractionorders, said distribution being determined by the width of the openingsin the CGH. The abscissa shows the diffraction orders. The 1^(st)diffraction order represents the viewing window 5 for the left eye, i.e.the left viewing window, through which the three-dimensional scene canbe viewed. Cross-talking into a viewing window for the right eye issuppressed by the decrease in light intensity towards higher diffractionorders and, additionally, by the zero point of the intensitydistribution.

Of course, the viewer can view the scene 6 (not shown in FIG. 5) of thehologram 3 with both eyes (see FIG. 5). For the right eye, the rightviewing window 5′ represented by the −1^(st) diffraction order of thelight source 1′ was chosen. As can be seen in the drawing, this lightinfluences the left eye at a very low intensity. Here, it corresponds tothe −6^(th) diffraction order.

For the left eye, the 1^(st) diffraction order corresponding to theposition of the light source 1 was chosen. The left viewing window 5 isformed likewise. According to an implementation of this invention, thecorresponding three-dimensional scenes (not shown) are reconstructedusing the light sources 1 and 1′ in a fix position in relation to theeyes. For this, the hologram 3 will be re-encoded when the light sources1 and 1′ are turned on. Alternatively, the two light sources, 1 and 1′,can simultaneously reconstruct the hologram 3 in the two viewing windows5 and 5′.

If the viewer moves, the light sources 1 and 1′ are tracked so that thetwo viewing windows 5 and 5′ remain localized on the eyes of the viewer.The same applies for movements in the normal direction, i.e.perpendicular to the video hologram.

Further, several viewers can view a three-dimensional scene ifadditional viewing windows are created by turning on additional lightsources.

Although the invention has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the invention defined in the appended claims is not necessarilylimited to the specific features or acts described. Rather, the specificfeatures and acts are disclosed as exemplary forms of implementing theclaimed invention. Modifications may readily be devised by thoseordinarily skilled in the art without departing from the spirit or scopeof the present invention.

1-41. (canceled)
 42. A display device for reconstructing an object,where the display device comprises a light source and an optical systemto illuminate a hologram-bearing medium being encodable with a hologram,wherein the display device is operable to time sequentially re-encode ahologram on the hologram-bearing medium for the left and then the righteye of an observer.
 43. The display device of claim 42, where thedisplay device is adapted to generate two observer windows at an imageplane of the light source by providing an appropriate illumination withthe optical system and where a hologram on the hologram-bearing mediumis re-encoded in synchronism with an activation of an observer window.44. The display device of claim 42, where the display device is adaptedto generate an observer window, the observer window being constrained tobe located substantially at an image plane of the light source.
 45. Thedisplay device of claim 42, where the display device is adapted togenerate an observer window, the observer window being smaller than thehologram-bearing medium.
 46. The display device of claim 45, where eachobserver window is approximately 1 cm×1 cm.
 47. The display device ofclaim 42, where the display device is adapted to generate separateobserver windows, one for each eye of an observer or where two observerwindows are generated simultaneously with the help of two light sources.48. The display device of claim 42, where the display device is adaptedto track the location of an observer's eyes and where the position of anobserver window is altered so that the observer can maintain a viewthrough each observer window even when moving his or her head.
 49. Thedisplay device of claim 42, comprising a position sensor to track thelocation of the observer's eye or eyes.
 50. The display device of claim42, where the display device is adapted such that the reconstructedobject can be anywhere within a volume defined by the hologram-bearingmedium and an observer window.
 51. The display device of claim 42, wherethe holographic reconstruction is described by Fresnel transform of thehologram and not by Fourier transform of the hologram.
 52. The displaydevice of claim 42, where the display device is adapted to generate adirect or inverse Fourier transform of the hologram at an observer planeat which the observer's eyes must be placed.
 53. The display device ofclaim 42, where the hologram-bearing medium is adapted to control thephase or the amplitude.
 54. The display device of claim 42, in which thehologram-bearing medium is a TFT flat screen.
 55. The display device ofclaim 42, in which the display device is a television or a multimediadevice or a gaming device or a medical image display device or amilitary information display device.
 56. The display device of claim 42,where the light source includes at least one of the following items:several light sources or at least one virtual light source or at leastone lineshaped light source or at least one point light source.
 57. Amethod of reconstructing an object using a display device, the displaydevice comprising a light source and an optical system to illuminate ahologram-bearing medium being encodable with a hologram, wherein thedisplay device is operated to time sequentially re-encode a hologram onthe hologram-bearing medium for the left and then the right eye of anobserver.
 58. The method of claim 57, further comprising the steps of:(a) computing the hologram by determining wavefronts at an observer eyeposition that would be generated by a real version of the object to bereconstructed; and (b) encoding the computed hologram in thehologram-bearing medium.
 59. The method of claim 57, where two observerwindows are provided at an image plane of the light source by providingan appropriate illumination with the optical system and where a hologramon the hologram-bearing medium is re-encoded in synchronism with anactivation of an observer window.
 60. The method of claim 57, where anobserver window is generated, the observer window being constrained tobe located substantially at an image plane of the light source.
 61. Themethod of claim 57, where an observer window is generated, the observerwindow being smaller than the hologram-bearing medium.
 62. The method ofclaim 61, where each observer window is approximately 1 cm×1 cm.
 63. Themethod of claim 57, where separate observer windows are generated, onefor each eye of an observer or where two observer windows are generatedsimultaneously with the help of two light sources.
 64. The method ofclaim 63, where the location of an observer's eyes is tracked and wherethe position of the observer window is altered so that the observer canmaintain a view through each observer window even when moving his or herhead.
 65. The method of claim 57, where the reconstructed object can beanywhere within a volume defined by the hologram-bearing medium and anobserver window.
 66. The method of claim 57, where the holographicreconstruction is described by Fresnel transform of the hologram and notby Fourier transform of the hologram.
 67. The method of claim 57, wherea direct or inverse Fourier transform of the hologram is generated at anobserver plane at which the observer's eyes must be placed.
 68. Themethod of claim 57, where the hologram-bearing medium controls the phaseor the amplitude.
 69. The method of claim 57, where the object is athree dimensional scene, the three dimensional scene being made up ofmultiple discrete points, the method further comprises the steps of: (a)selecting a point in the three dimensional scene to be reconstructed;(b) defining an observer window through which the reconstructed threedimensional scene will be seen; (c) tracing a pyramid from the edges ofthe observer window through the selected point and onto a region thatforms only a portion of the hologram-bearing medium; (d) generating,solely in that region of the hologram-bearing medium, holographicinformation needed to generate the holographic reconstruction of theselected point.
 70. The method of claim 57, where the hologram comprisesa region with information needed to reconstruct a single point of theobject to be reconstructed, the single point being visible from adefined viewing position, where the method further comprising the stepof: encoding the region with information for that single point in thereconstructed object, the region being the only region in the hologrambeing encoded with information for that single point, and the regionbeing restricted in size to form a portion of the entire hologram, thesize being such that multiple reconstructions of that single pointcaused by higher diffraction orders are not visible at the definedviewing position.
 71. The method of claim 57, where the region beingvariable in position and size, the position and size of the regiondepending on the location of the single point and on the location of thedefined viewing position.
 72. A sequence of holograms comprisingholograms, the holograms being computed according to the method of claim58.
 73. A computer being adapted to compute holograms according to themethod of claim
 58. 74. A holographic reconstruction generated by themethod as defined in claim
 58. 75. A hologram-bearing medium forencoding a hologram, the hologram-bearing medium being adapted to beencoded with a hologram being computed according to the method of claim58.
 76. A hologram-bearing medium for a display device of claim 42 forencoding a hologram, the hologram-bearing medium being adapted to betime sequentially re-encoded with a hologram for the left and then theright eye of an observer.
 77. A hologram-bearing medium for encoding ahologram, the hologram-bearing medium forming a part of a display deviceof claim
 42. 78. A holographic reconstruction generated by the displaydevice as defined in claim 42.